Learner-Generated Annotation of Learning Resources – Lessons from Experiments on Tagging
نویسندگان
چکیده
The importance of comprehensive annotations for learning resources is widely recognized. However, it is often unclear how these annotations should be created. A promising solution might be that learners annotate learning resources during execution of learning processes. This paper examines tagging as a learner-driven approach that can be used to get annotations on a collaborative level. The characteristics of learner-generated annotations in learning scenarios and the applicability of these annotations to describe learning resources are investigated. As empirical grounding, the results of three independent experiments are presented in order to inform decisions concerning the establishment of institutionalized settings deploying tagging approaches.
منابع مشابه
Inter-annotator Agreement for Dependency Annotation of Learner Language
This paper reports on a study of interannotator agreement (IAA) for a dependency annotation scheme designed for learner English. Reliably-annotated learner corpora are a necessary step for the development of POS tagging and parsing of learner language. In our study, three annotators marked several layers of annotation over different levels of learner texts, and they were able to obtain generall...
متن کاملError Annotation for Corpus of Japanese Learner English
In this paper, we discuss how error annotation for learner corpora should be done by explaining the state of the art of error tagging schemes in learner corpus research. Several learner corpora, including the NICT JLE (Japanese Learner English) Corpus that we have compiled are annotated with error tagsets designed by categorizing “likely” errors implied from the existing canonical grammar rules...
متن کاملSupersense tagging with inter-annotator disagreement
Linguistic annotation underlies many successful approaches in Natural Language Processing (NLP), where the annotated corpora are used for training and evaluating supervised learners. The consistency of annotation limits the performance of supervised models, and thus a lot of effort is put into obtaining high-agreement annotated datasets. Recent research has shown that annotation disagreement is...
متن کاملLEARNER INITIATIVES ACROSS QUESTION-ANSWER SEQUENCES: A CONVERSATION ANALYTIC ACCOUNT OF LANGUAGE CLASSROOM DISCOURSE
This paper investigates learner-initiated responses to English language teachers’ referential questions and learner initiatives after teachers’ feedback moves in meaning-focused question-answer sequences to analyze how interactional practices of language teachers, their initiation and feedback moves, facilitate learner initiatives. Classroom discourse research has largely neglected learner init...
متن کاملSemi-automated typical error annotation for learner English essays: integrating frameworks
This paper proposes integration of three open source utilities: brat web annotation tool, Freeling suite of linguistic analyzers and Aspell spellchecker. We demonstrate how their combination can be used to preannotate texts in a learner corpus of English essays with potential errors and ease human annotators’ work. Spellchecker alerts and morphological analyzer tagging probabilities are used to...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008